Reliability of Speeded Number-right Multiple-choice Tests Reliability of Speeded Number-right Multiple-choice Tests
نویسنده
چکیده
Contrary to common belief, reliability estimates of number-right multiple-choice tests are not inflated by speededness. Because examinees guess on questions when they run out of time, the responses to these questions show less consistency with the responses of other questions, and the reliability of the test will be decreased. The surprising implication is that adding questions to a multiple-choice test may lower its reliability when the test is speeded. This paper develops the mathematical derivations and shows the effects of speededness on reliability in simulations.
منابع مشابه
Does number of options in multiple choice tests affect item facility and discrimination? An examination of test-taker preferences
Multiple Choice tests are utilized widely in educational assessment because of their objectivity, ease of scoring, and reliability. This study aimed to compare IF and ID of MC vocabulary test items and attempted to find whether these indices are affected by the number of options. To this end, four 20 item stem equivalent vocabulary tests (3-, 4-, 5-, and 6-option MC) were administered to 194 (1...
متن کاملGuessing in Multiple Choice Questions: Challenges and Strategies
Introduction: Guessing is one of the most challenging issues in multiple choice questions. Several strategies, such as negative scoring, have been suggested for preventing students from choosing the right answer just by chance. However, there is no general agreement on using such strategies. The aim of this study was to review the scoring methods which are used for reducing guessing, and evalua...
متن کاملInvestigating the Effect of Changing Answers in Multiple-Choice Questions of Reading and Listening Tests in EFL Context
This study investigates whether the practice of answer changing on multiple-choice questions (MCQs) is beneficial for Iranian students’ overall test performance in EFL context. Several studies have shown that answer changing in multiple choice examinations is generally beneficial for improving scores. On the other hand, some studies have indicated that answer changing in multiple choice examina...
متن کاملThe Relationship between Translation Tests and Reading Comprehension: A Case of Iranian University Students
The present study seeks to investigate the potentiality of the translation task as a testing method for measuring reading comprehension. To achieve this objective, two types of translation tests, open-ended and multiple-choice tests, and two types of reading comprehension tests, multiple-choice reading comprehension and open-ended cloze tests were developed in this study. The reliability of the...
متن کاملDetermination of the Parameters of Six Multiple Choice Tests of Mashhad University of Medical Sciences (1389-90) based on Item-Response Theory (IRT)
Background: According to the industrialization of countries and development of societies, tests and methods are required to employ people in industries and organizations and make the best selection in getting workforce. Interviews, Written tests , and multiple choice tests are common methods used in employing people. Among these methods , multiple choice tests is the easiest one because of th...
متن کامل